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ABSTRACT 

Random bit errors that occur in pulse code modulated 
(PCM) data during the various phases of the telemetry-data- 
processing system will not only add a component of mean 
square error to the experimental data, but will also bias 
them. This paper derives a formula for the bias and de- 
scribes some of its characteristics. 
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THE BIASING EFFECT OF RANDOM BIT ERRORS 
ON BINARY TELEMETRY DATA 

by 

Morton Pasternack 
Goddard Space Flight Center 


INTRODUCTION 


PCM telemetry data, after digitization at a data processing facility, will contain errors which 
were introduced at various phases of the telemetry-data-processing system. We may think of the 
error sources as being divided into two parts: (a) prior to transmission, and (b) during and after 
transmission. The errors occurring prior to transmission result from imprecise experimental 
measuring devices, sampling error, quantizing error, encoding errors, etc. The errors occurring 
during and after transmission will occur in the form of bit errors and result from transmission 
signal errors, and detection and decision process errors. It is the latter type error (errors oc- 
curring during and after transmission) that is the subject of this paper. The orientation of this 
paper is mainly towards the situation where data are being transmitted from an experiment aboard 
a PCM satellite, and the statistic of interest is the mean value of the data points* transmitted 
during a time interval of duration AT. It should be noted, however, that the findings of this paper 
are equally valid for the case where the statistic of interest comprises the individual data points 
themselves, rather than an average of data points. 

Bit errors that occur during the transmission— detection— decisionprocess will add a component 
of mean square error to the mean square error which occurred in the data prior to transmission. 

It is obvious that if the probability of occurrence of a bit error is correlated with the transmitted 
value of that bit (i.e., the probability of a transmitted "one” being received in error is not equal to 
the probability of a transmitted "zero" being received in error), then a biasing error as well as a 
component of mean square error will be introduced into the data. What is not obvious is that 
"randomly distributed”^ bit errors will also result in a biasing type error, as well as in a mean 
square error. 


*A data point is defined for the purpose of this paper as a single measurement of an experimental parameter. The value of a data point 


t: 


can be any value from 0 to 2 m - 1, where m = the number of bits in a data channel. 


The term "randomly distributed” is used to describe the distribution of bit errors, for lack of a better short description. Each time it 
appears in this paper, its intended meaning is that the probability of any given received bit being in error is equal to the probability of 
any other received bit being in error (irrespective of the transmitted value of the given bit, the bit position within the data channel of 
the given bit, the occurrence or non -occurrence of previous bit errors, or any other attribute of the given bit). 
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BIASED VS. UNBIASED ESTIMATES 


Bias is defined as the deviation of the expected value of an estimating procedure from the 
true value. The expected value in turn is the average estimate that would ultimately be approached 
if the estimating procedure were repeated indefinitely. 

We can look upon a (the mean transmitted value) as the true value, and the transmission- 
detection-decision process as the estimating procedure that produces the estimate P (the mean 
received value). P is then by definition an unbiased estimate of a, if die expected value of p is 
equal to <*. Conversely, P is by definition a biased estimate of a, if the expected value of p does 
not equal a. 

MEAN SQUARE ERROR VS. BIAS ERROR 

Unlike the mean square error, the bias error is independent of n , the number of data point 
values (DPV's) used to compute /3. Whereas the mean square error of p can be reduced by in- 
creasing n, the bias error remains constant for' all values of n . The mean square error results 
in an imprecise estimate and the bias type error results in a distorted estimate. If a time plot 
were made of the p values, curve fitting techniques could, for the most part, eliminate the effects 
of the mean square error, but they could not eliminate the effects of the bias. 

Formulas for computing the mean square error resulting from randomly distributed bit errors 
have been derived previously by S. Karp (Reference 1), by M. B. Rudin and J. Siegel (Reference 2), 
and by others. It is the purpose of this paper to derive a formula for the biasing type error re- 
sulting from randomly distributed bit errors, and to describe some of the characteristics of this 
bias. 

DERIVATION OF THE BIAS FORMULA 
Assumptions 

Two assumptions are made: 

1. For each transmitted data point value (a. ) , there is a corresponding received data 
point value [pP ] . 

2. P e is constant for each of the m xn bits that comprise a. 

Symbol Definitions 

a. = the i th transmitted data point value (o < a. i < 2 m - l) 

/3. = the i th received data point value (o</3. < 2 m - l) 
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1/n £ 

i=l 


CL 


i 


P = 

E (^i) - 

W = 

n = 
m = 

p* = 


P ( B ij = 0 = 

P( Bij = 0) = 

Derivation 

By definition, 


i /n 

i=i 

the expected value of /3 i 
the ejected value of p 

the number of data point values transmitted 
the number of bits in a data channel 

the bit error probability (this is equal to the probability that the transmitted 
value of any given bit, zero or one, will differ from the received value). 

the bit position within a data channel (j = 0 represents the low order bit posi- 
tion; j = m - 1 represents the high order bit position) 

the value (zero or one) of the j th bit position in the binary representation of a. 
the value (zero or one) of the j th bit position in the binary representation of /3 i 
the probability that the value of B. . is one 
1 - p(b. . = i) = the probability that the value of B i . is zero. 


m- i 

21 


j=0 


m- 1 

3 i = H B i, 2 j 


j = 0 
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and 


m- 1 

E(/3i) = 2Z E(Bii)2i 

j=0 


= [ P ( B ‘i = X ) (1) + = °U°>] 2i 

j=0 


ro - 1 

= ^ 2ip ( B ij = 1) ' 

i = o 


Now, p(b.. = l ) is equal to l -P e when the value of the corresponding A., is one, and is equal to 
P e when the value of the corresponding A u is zero. This can be expressed as 

P(Bi, = i) = (i-P.)(\,) + P e (l-Ay) • 


Therefore, 


m~~ 1 

E/ 3 , = £* [( 1 - P e)(A ij ) + P e(l-A lj )] 

j^O 


m~ 1 


= J2 2i [ P e + (1 - 
j=0 



m~ 1 ro~l 

= p . 22 2i + ( i ' aP «)Z] A « 2i 

j^o j=0 

= P e (2 m -l) + (l-2P e )a. . 


Hence, 


E(/3) 



k 22 e (^) = ^£t p ^ 2m-l) + (1 ~ 2Pe) a J 

;=i i = l 


= P e (2 ra - l) + (l - 2P e 



■P. ( 2 m - 1 ) + (l-2P.)a . 
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Thus, 


bias = E(/3) - a = P e (2 m - l) + (l - 2P e ) a - a 

= P e (2 m -l) - 2P o a 



SOME CHARACTERISTICS OF THE BIAS 

From the formula 


- - / 2 m - 1 — \ 
EOS) " a - 2P c y 2 ■ 


we can see the following: 

a. The absolute value of the bias is a function of the absolute difference between (2 m - l)/2 
and a, where 2 m - l is the maximum DPV of an m bit data channel. When a = (2 m - l)/2 , the 
bias is equal to zero. When a = 0 or 2 m - 1 , the absolute value of the bias is a maximum. 

b. The bias is directly proportional to P e . 

A feel for the magnitude of the bias and the manner in which it varies can be derived by sub- 
stituting numbers for m and P e , and varying the value of a. The results are presented in Table 1. 

The values chosen for m and P e are 9 and 0.01, respectively. 

Referring to the second entry in Table 1, note that when m = 9, P e = 0.01, and a = 51.1, then 
E(3) = 55.188, and the bias = 4.088. This means that if an infinite number of DPV f s whose average 
was 51.1 were transmitted by means of a 9-bit data channel, with a bit error probability of 0.01, 
then the average of the DPV f s received would be 55.188. The bias would be 55.188 - 51.100 = 4.088. 

It was noted earlier that the bias is directly proportional to p e . Therefore, using the example 
just given, when a = 51,1 and m = 9, 

the bias = 40.88 when P e = 0.1, 
the bias = 4.088 when P e = 0.01, and 
the bias = 0.4088 when P e = 0.001. 

Figure 1 graphically portrays the relationship between a, E(£), and E(£) - a . An extremely 
high value for P e was utilized (p c = O.l), in order to make the relationship on the chart legible. 

The vertical distance between the dashed line, E(£) , and the solid line, a, at any a value, represents 
the bias for that a value. For example, if a - 102.2, then E(^) = 132.86 and the bias = 30.66. 
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Table 1 


Relationship of Mean Transmitted DPV (a) , 
Expected Value of Mean Received DPV (E(/3)), 
and Bias (E(§) - a), when m = 9, and P e = 0.01. 


a 

ECS) 

Bias = E(/3) - a 

0(2 m - 1) = 0 

5.110 

5.110 

0.1(2 m - 1) = 51.1 

55.188 

4.088 

0.2(2 m - 1) = 102.2 

105.266 

3.066 

0.3(2” - 1) = 153.3 

155.344 

2.044 

0.4(2 m - 1) = 204.4 

205.422 

1.022 

0.5(2” - 1) = 255.5 

255.500 

0 

0.6(2 m - 1) = 306.6 

305.578 

-1.022 

0.7(2” - 1) = 357.7 

355.656 

-2.044 

0.8(2” - 1) = 408.8 

405.734 

-3.066 

0.9(2” - 1) = 459.9 

455.812 

-4.088 

1.0(2” - 1) = 511.0 

505.890 

-5.110 



Figure 1— Graphic presentation of relationship 
between a, E(£), and E(£) - a (m = 9, P e =0.1). 


Table 2 

Relationship of Mean Transmitted DPV(^), Bias (e(£) - a ), and Bias 
as a Percentage of a[l00 (E(0) - a^ajwhen m = 9 and P e = 0.01. 


a 

Bias = E(/3) - a 

100 (E(/3) - a)/ a 
(percent) 

0(2 m 

- 

1) 

= 

0 

5.1100 

Not Defined 

0.005(2 m 

- 

1) 

= 

2.555 

5.0589 

198 

0.01 (2” 


1) 

= 

5.11 

5.0078 

98 

0.02 (2 m 

- 

1) 

- 

10.22 

4.9056 

48 

0.05 (2 m 

- 

1) 

= 

25.55 

4.5990 

18 

0.10 (2 m 

- 

1) 

= 

51.10 

4.0880 

8 

0.20 (2 m 

- 

1) 

= 

102.20 

3.0660 

3 

0.30 (2” 

- 

1) 

= 

153.30 

2.0440 

1.33 

0.40 (2” 


1) 

= 

204.40 

1.0220 

0.50 

0.50 (2” 

- 

1) 

= 

255.50 

0 

0 

0.60 (2” 

- 

1) 

= 

306.60 

-1.0220 

-0.33 

0.70 (2” 

- 

1) 

= 

357.70 

-2.0440 

-0.57 

. 0.80 (2” 

- 

1) 


408.80 

-3.0660 

-0.75 

0.90 (2 m 

- 

1) 

= 

459.90 

-4.0880 

-0.89 

1.00 (2” 

- 

1) 

= 

511.00 

-5.110 

-1.00 

. 
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Another important relationship, probably more important than the absolute bias, is the bias as 
a percentage of a. Table 2 shows the relationship of this percentage to the value a, for m = 9 and 
P e = 0.01. 

The figures in Table 2 give a good indication of the magnitude of the bias problem when P e is 
high (p e = 0.01) . For example, if we have a 9-bit data channel, a 0.01-bit error probability, and 
a 10.22 value of a, then the estimate of a, based on the received values, would be biased by 48 per- 
cent. It should also be noted that the bias, as a percentage of a, is directly proportional to P e . 
Therefore, using the entry for a = 10.22 in Table 2 as an example, when a = 10.22 and m = 9, 

the bias as a percentage of a = 480 percent when P e = 0.1, 

the bias as a percentage of a = 48 percent when P e = 0.01, 

the bias as a percentage of a = 4.8 percent when P e = 0.001, and 

the bias as a percentage of a = 0.48 percent when P e = 0.0001. 


TIME PLOT DISTORTIONS 


The previous section of this paper dealt with the effect of randomly distributed bit errors on 
the relationship between a mean transmitted DPV and the corresponding mean received DPV. In 
this section, note is taken of randomly distributed bit errors and their distorting effect on time 
plots. Figures 2 and 3 graphically illustrate examples of this distortion. The charts are based on 
the following assumptions: 

1. The transmitted DPV's for a given experiment, plotted on a time scale, take the form of a 
sine wave. 

2. A time plot is made from the received DPV's. Each point on this time plot is made up of 
an average of n received DPV T s during an increment of time equal to At . 

3. At approaches 0 as n approaches oo. 


2 

i— 

z 

2 


I 

O 




Figure 2— Transmitted sine wave (with amplitude = 
(2 m - 1)/2)vs. the received curve (m = 9, P # = 0.1). 


Figure 3-Transmitted sine wave (with amplitude = 
(2 m - l)/4)vs. the received curve (m = 9, P e = 0.1). 
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4. The received DPV's contain randomly distributed bit errors. 

5. m = 9 and P e = 0.1. (A high P e was chosen in these illustrations in order to make the 
relationship on the charts legible.) 

Figures 2 and 3 show the relationship of the transmitted curve versus the received curve. In 
both figures, the minimum value of the transmitted curve is zero. Figure 2 shows the relationship 
when the amplitude of the transmitted sine wave is equal to (2 m - l)/2; Figure 3 shows the relation- 
ship when the amplitude of the transmitted sine wave is equal to (2 m - l)/4 . 

In Figure 2, the transmitted curve fluctuates about (2 m - l)/2 , the mid-point of an m-bit data 
channel. When the transmitted curve is above (2 m - l)/ 2, the received curve is below the transmitted 
curve. When the transmitted curve is below (2 m - l)/2 , the received curve is above the transmitted 
curve. In Figure 3, the transmitted curve is never above (2 ra - l)/2 . The received curve is, there- 
fore, never below the transmitted curve. In both Figure 2 and Figure 3, the maximum absolute 
bias occurs when the transmitted curve value is zero. At that point, the bias is equal to P e (2 m - l} . 

In both figures the value of the absolute bias decreases as the curve approaches (2 m - l)/ 2 , at 
which point the bias is zero. 

CONCLUSION 

Intuition might lead one to conclude that if bit errors were randomly distributed, the averaging 
of a large number of received DPV f s would tend to cause the effects of the bit errors in one di- 
rection to cancel those in the opposite direction. It would follow that the mean received DPV could 
serve as an estimate of the mean transmitted DPV, and that this estimate would be unbiased. Un- 
fortunately this would not be the case. The estimate would be a biased estimate and the amount of 
the bias would be equal to 



a 


)■ 


Curves developed from received DPV f s which are biased, will be distortions of the curves 
described by the transmitted DPV f s. The amount of distortion of a given segment of a curve will 
be dependent upon the value of P e and of the difference between the value of the points on the curve 
and the value (2 m - l)/2 . The closer a segment of the transmitted curve is to the value (2 ra - l)/2 , 
the less the distortion. 

(Manuscript received January 7, 1966) 
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